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Abstract. The purpose of the research is to 
analyze the effect of STEM applications on 
mathematics pre-service teachers’ math- 
ematical literacy self-efficacy, technological 
pedagogical knowledge and mathemati- 
cal thinking skills and their views on STEM 
education. This research has been carried 
out by 29 mathematics pre-service teach- 
ers who are schoolers at the educational 
faculties of Mus Alparslan University. The 
research was completed in 10 weeks (3 
hours per week) in spring semester of 
2016-2017 academic year. Mixed research 
approach was used in the study. “Math- 
ematical Literacy Self-Sufficiency Scale’ 
“Mathematical Thinking Scale’ “Technolog- 
ical Pedagogical Area Information Scale” 
and “STEM Interview Form for Mathematics 
Pre-service Teachers” were used as data 
collection instruments. The collected data 
were analyzed, and it was certain that the 
STEM applications positively affected the 
pre-service teachers’ mathematics literacy 
self-efficacy and technological pedagogical 
content knowledge. However, STEM appli- 
cations were not seemed to have a positive 
effect on mathematical thinking. Moreover, 
when the opinions of the pre-service teach- 
ers were examined, it was identified that the 
STEM applications changed positively the 
opinions of the pre-service teachers about 
the mathematical literacy, and that they 
lacked many subjects such as field knowl- 
edge and pedagogy knowledge about 
STEM education. Suggestions were made in 
the direction of the findings obtained. 
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Introduction 


Rapid change in science and technology is changing the skills that 
countries expect from individuals of today (Yildirim & Selvi, 2017). As a 
result of these changes, countries’ expectations for their skills in educa- 
tion also change. In this change, those who understand mathematics and 
do mathematics have more options to shape the future. Along with the 
changes, the mathematics and mathematics education need to be rede- 
fined and reviewed in line with the determined needs (Ministry of National 
Education [MoEN], 2004). Those who understand STEM disciplines in our 
changing world and who are equipped with the skills and knowledge of 
the 21* century in relation to these disciplines play an important role in 
shaping the future of countries in economics, technology and world leader- 
ship (Yildirim, 2016). When all this is taken into consideration, it is necessary 
to realize that mathematics must be literate for all individuals in order to 
understand mathematics and use it in everyday life, and that mathematics 
is important for economic development. Mathematical literacy focuses on 
measuring the capacity of students to formulate, use and interpret math- 
ematics in different contexts (MoEN, 2016). 

Thus, countries are constantly amending in mathematics programs 
(MoEN, 2004). However, another important reason for changing the math- 
ematics program is the PISA / TIMSS exams which enable the mathematics 
proficiency to be determined. Mathematical competence helps individuals 
to recognize the role mathematics plays in the world and to help them 
make judgments and decisions that are solid grounds for individuals to be 
constructive, responsive, and reflective citizens (MoEN, 2017). From this 
point of view, it is important for the students to be mathematically literate 
individuals in order to be successful in the PISA / TIMSS exams. With this 
point, the first task falls to the teachers. It is important for the students 
that the teachers are primarily literate in mathematics. Therefore, firstly, 
teachers should be educated as mathematics literate. STEM education also 
has an important effect on the education of individuals for being literate 
in mathematics. 


Journal of Baltic Science Education, Vol. 17, No. 2, 2018 


ISSN 1648-3898 /Print/ STEM APPLICATIONS IN MATHEMATICS EDUCATION: THE EFFECT OF STEM APPLICATIONS ON 
DIFFERENT DEPENDENT VARIABLES 
ISSN 2538-7 138 /onine/ (P. 200-214) 


From this point of view, mathematics education has an important role in training well-equipped individuals 
with the skills and knowledge required by the 21st century. Mathematical literacy is very important to come to 
this important position. There is also a need for individuals with adequate skills in technology as well as the need 
for mathematically literate individuals in the 21st century business world. Today, the need for technology liter- 
ate individuals who understand technology, use it correctly and closely follow technological developments has 
also increased. According to MoEN (2006), technology is not just electronic devices such as computers and their 
various applications. Technology is both a type of knowledge that uses concepts and skills derived from other 
disciplines (science, mathematics, culture, etc.), as well as the provision of this knowledge to human service in 
order to meet a specified need by using materials, energy and tools, or to solve a specific problem. Technology is 
expressed as a process in which tools, structures or systems are developed and changed to meet people’s needs 
and demands. Cavanagh and Trotter (2008) present the opportunity to use science and mathematics knowledge 
to solve the problems with technology faced by the people in their everyday life. In this context, it is important 
to integrate technology into educational environments. Therefore, it is necessary to integrate technology into 
teacher training programs and to have technology skills so that teachers can use technology and teach their 
students accordingly (Hofer & Grandgennett, 2012). In this context, it is up to the pre-service teachers to be 
conscious about the Technological Pedagogical Domain Information (TPACK) for future reference). Bilici and 
Baran (2015) emphasized that science teachers must be equipped with the knowledge and skills necessary 
to integrate technology effectively into the teaching process, that is, they must have TPACK. It is important 
for mathematics teachers to have TPACK as well as the science teachers have and use them effectively in the 
teaching process. TPACK can be expressed as an effective and efficient use of technology in students’ learning 
during the teaching of a subject (Mishra & Koehler, 2006). In this context, technology can be used effectively 
in educational activities and allows a deeper understanding of science, mathematics and engineering. It also 
includes a product releasing process that incorporates the engineering, scientific and mathematical theoretical 
sub-structure of the engineering design process. Moreover, technology allows students to use the information 
they learn in everyday life, as well as the information available in STEM fields (Lantz, 2009). In other words, the 
technology dimension, which is one of the components of STEM education, is important in the STEM education 
in effectively using it in educational environments. 

When the literature is examined, it appears that there are many studies in which the effects of various re- 
search groups and STEM education on students’ attitudes, motivation, academic achievement, scientific process 
skills and problem-solving abilities are examined. (Cotabish, Robinson, Dailey & Hughes, 2013; Yamak, Bulut & 
Dindar, 2014). Similary, there are also studies in which the opinions of teachers and pre-service teachers on 
STEM education were presented (Gilgtin, Yilmaz & Caglar, 2017; Lee, Park & Kim, 2013; Lee et. al., 2012; Thomas, 
2014; Wang, 2012). However, when the literature is examined, no research has examined the effects of STEM 
education applications on mathematics literacy self-efficacy, mathematical thinking and TPAB. This is important 
because this is the first research to examine the effects of STEM applications on these variables. Moreover, it is 
seen that the work done on elementary school mathematics teachers was not sufficient, this research is proven 
to be an important contribution to the literature. 

In this research, it has been aimed to determine the effects of STEM applications on mathematics pre-service 
teachers’ mathematical literacy self-efficacy, technological pedagogical content knowledge and mathematical 
thinking skills and the opinions of mathematics pre-service teachers on STEM education. For this purpose, an- 
swers to the following research questions have been sought. 

1. What is the effect of STEM applications on math literacy self-efficacy? 

2. What is the effect of STEM applications on technological pedagogical content knowledge? 
3. What is the effect of STEM applications on mathematical thinking skills? 

4. What are the views of mathematics pre-service teachers for STEM education? 


Methodology of Research 
Model 
In this research, mixed research approach has been used. This research is one of the mixed research approach 


and it is a quantitative weighted study. The main reason for using the mixed method in the research is that it 
involves both quantitative and qualitative studies of the mixed research approach. Creswell (2006), Jnonson & 
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Onwuegbuzie (2004) stated that the purpose of mixed research approach is to present the study investigate the 
study in all its dimensions examining thoroughly. 

This research was performed with STEM applications integrated with Science, Technology and Society courses. 
In order to determine the effects of these applications, a single group pre-test post-test model was applied. While 
STEM practices are independent variables, mathematics literacy self-efficacy, mathematical thinking skills, and 
technological pedagogical knowledge of pre-service teachers are dependent variables. The symbolic view of the 
research model is shown in Table 1 below. 


Table 1. Symbolic view of the experimental model. 


Group Pre-test Application Post-test 
D MLSS SA MLSS 
MTS MTS 
TPACK TPACK 


D: Study Group; SA: STEM applications integrated with Science, Technology and Society courses 
MLSS: Mathematics literacy self-efficacy scale; MTS: Mathematical Thinking Scale 
TPACK: Technological pedagogical content knowledge scale 


Sample 


The quantitative sample of the research is composed of 29 students who are studying at a Mus Alparslan 
University in elementary mathematics teaching in the spring of 2016-2017 academic year. The qualitative study 
group of the study consisted of 12 students studying in the 4th grade mathematics education department which 
took Science, Technology and Society courses. A purposeful sampling method was used in selecting the qualitative 
study group. Two criteria were chosen in the selection of the students in the qualitative study group. The criteria for 
these criteria are those who participate in all of the applications and do not miss the school. The second criterion 
is the students who want to improve themselves in STEM education and voluntarily participate in the interview. 

For the simple, students who were studying in the field of mathematics education were selected. This is because, 
when the field text is examined, a study on mathematics education in this department of STEM applications has 
not been found. It is also seen that STEM education applications are carried out especially in science course. With 
this study group both the studies were carried out with mathematics teaching students and STEM applications 
were integrated in mathematics courses. For these reasons, studies were carried out with the pre-service teachers 
who are studying in the elementary school mathematics teaching department. 


Study Environment and Process 


STEM applications within the scope of Science, Technology and Society lessons were carried out in the STEM 
Laboratory for 10 weeks during spring semester of the 2016-2017 academic year. The STEM laboratory is made up 
of hexagonal tables designed for pre-service teachers’ group work. In these laboratories, prospective teachers have 
materials for STEM applications. Among these materials are materials used in everyday life and STEM building sets. 

Applications in the STEM laboratory have been developed in accordance with the STEM integration stages 
developed by Yildirim (2016). In this context, STEM applications are started with Mathematics domain. Theoretical 
background is given firstly in the field of mathematics. Subsequently, a connection with science was established 
and the theoretical sub-structure of Science was given. In the direction of mathematics and science theoretical 
sub-structure, engineering applications were done, and a product was created. The applications performed in 
primary school mathematics teaching are given in Table 2. 
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Table 2. Steps of STEM application regarding the research. 


Mathematics: Science: Engineering design Technolo 21st century 
Learning Field Subject Field processes gy skills 
Teaching Whole Numbers Simple Machines Elevator Designs Elevator 

Temperature-Heat Heat-insulated house House 
Ratio and proportion Simple Machines Catapult Design Catapult 
Conversion Geometry Wind Energy Windmill Design Windmill Instructional tech- Cooperation 
Probability and Statistics ‘Kinetic energy to Roller Coaster Park Design _ Roller Coaster nologies added in the Communication 

y Potential energy (3 tracks) Tracks application process Creativity 
(Computer etc.) Critical thinking 

Field Measurement Balance Bridge Design Bridge 
Geometrical shapes Optics Hexagonal Telescope design Telescope 
Problems Chemical Reactions Rocket design Rocket 


When the table is examined, firstly, the 5E learning model and the lesson plan suitable for project - based 
learning have been prepared in STEM education about the STEM applications. The STEM applications related to 
the lesson plans were prepared in accordance with the steps given in Table 2. 


Data Collection Instruments 
Quantitative Dimension 


“Technological Pedagogical Area Information Scale” developed by Haci6meroglu, Sahin and Arcagok (2014) was 
used. This scale was developed in accordance with the 5-point Likert type. The researchers found the KMO value of the 
scale to be .88. The Barlett test of the scale was found to be significant. The reliability value of the scale was calculated 
as 0.94, while for the sub-scale included in the scale, the reliability value was calculated as .89, .87, .87, .86, .82, .87, 
.84, .77, .81. The scale consists of 9 sub-dimensions and 46 items in total. The reliability value of the scale within the 
scope of the research was calculated as .80. 

The “Mathematical Thinking Scale” developed by Ersoy and Baser (2013) was used. This scale was developed in 
accordance with the 5-point Likert type. The researchers calculated the KMO value of the scale as .759 and the Barlett 
sphericity test was found to be significant. The reliability of the scale was calculated to be .78. The scale consists of 4 
sub-dimensions and 25 items in total. In the scope of the research, the reliability value of the scale was calculated as .84. 

The “Mathematics literacy self-efficacy scale” developed by Ozgen and Bindak (2008) was used. This scale was 
developed in accordance with the 5-point Likert type. The researchers found the KMO value of the scale to be .92. The 
Barlett test of the scale was found to be significant. The reliability of the scale was calculated to be .92. The scale consists 
of one dimension and 25 items. The reliability value of the scale within the scope of the research was calculated as .90. 

The reliability of the scales used to collect quantitative data were examined separately and the value of all was 
found to be higher than .70. This indicates that these scales can be used in research. 


Qualitative Dimension 


A fully structured interview form consisting of 10 questions was formed in order to determine the views of the 
12 pre-service teachers (Mathematics Pre-service Teachers STEM Interview Form) who are researching in Mathemat- 
ics Education. The fully structured interview form created was implemented after the application. In the course of 
the creation of the interview form, two experts were consulted, one being a lecturer in mathematics education 
and the other being a lecturer in the field of science education. Regulations were made on the fully structured 
interview form in line with the views received. After the regulations, a pilot research was carried out by applying 
this interview form to a student studying in mathematics education major. The form was finalized as a result of the 
pilot study. As a result of the fully structured interview form applied to the pre-service teachers, questions were 
also asked in the places where they thought that they were missing through a fully structured interview form in 
order to clarify the opinions of the pre-service teachers. In the scope of the research, interviews have been held 
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in order to be able to reveal the views of the pre-service teachers about the implementations. Negotiations have 
recorded with the help of a voice recorder after obtaining permission from pre-service teachers. The obtained 
voice recordings have been put on paper and transcripts have been created. Data have been analyzed with the 
help of created transcripts. When interviewing with pre-service teachers, it has been asked what kind of features 
ona teacher are needed for STEM education, thoughts about the disciplines in abbreviation of STEM, mathematics 
literacy. Moreover, pre-service teachers have been asked whether they are qualified for STEM implementations 
and their answers have been received. 


Results of Research 
Quantitative Results 


This part of the research has included the findings from quantitative data. Findings are explained alternately 
in line with mathematical literacy self-efficacy, technological pedagogical knowledge and mathematical thinking 
skills. In this context, the results of Shapiro Wilk have been first given in order to understand whether the quantita- 
tive data were distributed homogeneously for the first time. 

The data obtained in the Shapiro Wilks analysis to find the results of the first research question are given in 
Table 3. 


Table3. Shapiro Wilks test results on the scale of mathematical literacy self-efficacy, mathematical thinking 
and technological pedagogical content knowledge. 








Scale Test Statistics df p 
Pre-test .948 28 197 
Mathematical Literacy Self-Efficacy Scale 
Post-test .984 28 .937 
Pre-test 979 28 817 
Mathematical Thinking Scale 
Post-test .964 28 405 
Pre-test 973 28 640 
Technological Pedagogical Content Knowledge Scale 
Post-test 954 28 613 


When Table 3 is examined, it is seen that Mathematical Literacy Self-Efficacy, Mathematical Thinking and Tech- 
nological Pedagogical Content Knowledge scales have a normal distribution according to the results of Shapiro 
Wilks test. Therefore, parametric tests were used to analyze the scales. Descriptive statistical information about 
the scales is given in Table 3. 

The information on descriptive statistics obtained from mathematical literacy self-efficacy, mathematical 
thinking skills, and technological pedagogical content knowledge scales used in the first research questionnaire 
are given in Table 4. 


Table 4. Descriptive statistics on mathematical literacy self-efficacy, mathematical thinking, and technologi- 
cal pedagogical content knowledge scales. 








Scale Test N X sD Minimum Maximum 
Pre-test 29 91.33 9.36 74 112 
Mathematical Literacy Self-Efficacy Scale. 
Post-test 29 96.74 11.76 72 113 
Pre-test 29 93.58 7.78 78 108 
Mathematical Thinking Scale 
Post-test 29 94.55 9.22 r6s) 115 
Technological Pedagogical Content Pre-test 29 162.48 21.86 115 199 
Knowledge Scale Post-test 29 175.55 16.56 159 209 
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When Table 4 is examined, the points for the scales are found as followed; mathematical literacy self-efficacy 
scale pre-test (x = 91.33) and post-test (x = 96.74); The Mathematical Thinking Scale pre-test (x = 93.58) and the 
post-test (x = 94.55) and the Technological Pedagogical Content Knowledge scale pre-test (x = 162.48) and post- 
test (K=175.55). 

The results obtained from the t-test analysis for the dependent groups, which were made in order to deter- 
mine the effects of the STEM applications on the effects of the mathematics literacy self-efficacy of the pre-service 
teachers, are given in table 5. 


Table5. = T-test results test results on the scale of Mathematical Literacy Self-Efficacy. 


Pre - test Post test 


N x sD X sD t p 


Mathematical Literacy Self-Efficacy Scale. 29 91.33 9.36 96.74 11.76 2.670 .013* 


When Table 5 is examined, there is a significant difference statistically between the mathematical literacy 
self-efficacy scale pre-test and post-test points arithmetic calculations of the pre-service teachers who research in 
mathematics teaching (28) = 2.670, p <.05]. The results obtained from the t-test analysis for the dependent groups 
in order to reveal the effects of the STEM applications on the mathematical thinking ability of the pre-service 
teachers are given in the Table 6. 


Table 6. T-test results of the mathematical thinking scale. 


Pre-test Post-test 


N x sD X sD t p 


Mathematical Thinking Scale 29 93.58 7.18 94.55 9.22 406 688 


When Table 6 is examined, there is no statistically significant difference between pre-test post-test arithmetic 
average of Mathematical Thinking Scale results of pre-service teachers who research mathematics teaching [t (28) 
=.406, p> .05]. It is also examined whether there is a difference in terms of the sub-dimensions of the mathematical 
thinking scale. The t-test results for the sub-scales of the mathematical thinking scale are given in Table 7. 

The data obtained as a result of the t-test analysis for the dependent groups in order to be able to reveal 
the effects of the STEM applications on the sub-dimensions of the mathematical thinking scale of the pre-service 
teachers are given in Table 7. 


Table 7. Results of t-test for sub-dimensions of mathematical thinking scale. 


Pre-test Post-test 
N x sD Xx sD t p 
Mathematical Think- — High-Level Thinking 29 23.65 3.08 25.31 253 2188 037* 
ing Scale Tendency 
Reasoning 29 15.89 2.76 23.65 1.92 2.079 .047* 
Mathematical Thinking 29 33.75 4.18 33.03 3.42 677 504 
Problem Solving 29 26.37 3.09 26.58 3.08 .240 812 
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When t-test results for mathematical thinking scale sub-dimensions are examined, it is seen that there is a 
significant difference between high-level thinking tendency pre-test and post-test arithmetic average [t(28)=2.188, 
p <.05], and reasoning pre-test and post-test arithmetic average [t(28)=2.079, p <.05]. However, there is no sig- 
nificant difference between Mathematical Thinking Skill pre-test and post-test arithmetic averages [t(28)=.677, 
p >.05] and Problem Solving pre-test and post-test arithmetic averages [t(28)=.240, p >.05] . 

The data obtained from the t-test analysis for the dependent groups in order to reveal the effects of the STEM 
applications on the pedagogical content knowledge of the pre-service teachers are shown in Table 8. 


Table 8. T-test results of the technological pedagogical content knowledge scale. 


Pre-test Post-test 


Technological Pedagogical Content N x SD x SD t p 
Knowledge Scale 
29 143.28 21.86 175.55 16.56 2.490 .019* 


When Table 8 is examined, it is seen that there is a statistically significant difference between the pre-test 
and post-test arithmetic average [t(28)=2.490, p <.05] of the Technological Pedagogical Area Knowledge Scale of 
the pre-service teachers who are studying in the department of mathematics education. Whether or not there is 
a differentiation in terms of subdimensions of the Technological Pedagogical Content Knowledge Scale has also 
been examined. The t-test results for the sub-dimensions of the Technological Pedagogical Content Knowledge 
Scale are given in Table 9. 

The data obtained from the t-test analysis for the dependent groups in order to be able to reveal the effects 
of the STEM applications on the sub-dimensions of the technological pedagogical content knowledge scale of the 
pre-service teachers are shown in Table 9. 


Table 9. T-test results for the sub-dimensions of the technological pedagogical content knowledge scale. 


N Pre-test Post-test t p 
x sD x sD 
a Technology Knowledge 29 22.86 5.23 25.48 5.39 1.785 .085 
E Content Knowledge: Mathematics 29 9.62 2.62 11.17 2.77 2.531 .017* 
5 Content Knowledge: Social sciences 29 7.37 2.32 9.13 2.35 2.628 .014* 
8 Content Knowledge: Science 29 7.38 2.33 8.79 2.40 3.532 .001* 
88 Content Knowledge: Reading/Writing 29 10.58 3.25 12.75 2.76 2.649 .013* 
<! & Pedagogy Knowledge 29 24.24 5.69 28.00 5.02 2.685 .012* 
is i Pedagogical Content Knowledge 29 12.79 3.23 14.27 2.89 1.989 057 
2 Technological Field Information 29 12.96 3.12 14.20 2.65 1.695 101 
= Technological Pedagogy Knowledge 29 13.44 3.42 15.17 2.31 2.375 .025* 
= Technological Pedagogical Content Knowledge 29 27.03 6.16 30.34 4.05 2.753 .010* 


When Table 9 is examined, it is seen that there is a statistically significant difference between the pre-test 
and post-tests’ arithmetic means of subscales of the Field Knowledge of STEM applications’ technological peda- 
gogical content knowledge scale - Mathematics, Social Science, Science and Literacy. In addition, it is observed 
that STEM applications have a statistically significant difference between the pre-test and post-test of arithmetic 
means of Pedagogical Information, Technological Pedagogical Knowledge and Technological Pedagogical Content 
Knowledge subscales. However, there is no statistical difference between the pre-test and post-test results of the 
sub-dimensions of Technology Knowledge, Pedagogical Content Knowledge and Technological Field Knowledge. 
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Information on Qualitative Findings 


Qualitative findings related to the qualitative data obtained in the second research question of the research 
were given in order to form an integrity in the research. In this context, firstly the opinions of pre-service teachers 
on mathematical literacy were included. 


Answers to yhe Question “What is Mathematics Literacy?” 


Pre-service teachers were asked “What is mathematical literacy?” Pre-service teachers have defined mathematical 
literacy as “following mathematical developments, reading the history and theories of mathematics, reading math- 
ematics correctly and using it correctly in our lives, and understanding the philosophy of mathematics and practic- 
ing it in everyday life”. However, some pre-service teachers have defined mathematical literacy in the following way. 


O1: To express mathematical terms in a clear way, to master the field, to make connection with real life and 
follow mathematical developments. 


03: It is said that countries that understand what they read and solve them in the PISA/ TIMSS examinations 
have a good mathematical literacy. From this point of view, teaching mathematics in a concrete way is to un- 
derstand, to make connection with everyday life and to follow the developments is the mathematical literacy. 


O9: Mathematics literacy is the constant improvement of the teacher to convey mathematics to the students 
in a concrete way. 


O11: Mathematics literacy is to understand mathematics, develop a positive view of mathematics, and use 
mathematics in line with their needs. 


After the opinions of the prospective teachers about the mathematical literacy were asked, the prospective 
teachers were asked whether they were mathematical literate or not. Pre-service teachers’ answers are shown in 
Table 10. 


Table 10. The answers given in the question “Do you think you are a mathematical literate individual? 


Codes f % 


Yes 8 66.66 
No 4 33.34 


| am a mathematical literate individual 


When Table 10 is examined, 66.66% (n = 8) of the pre-service teachers stated that they are mathematical liter- 
ate individuals whereas 33.34% (n = 4) of the pre-service teachers stated that they are not mathematical literate. 
From this point of view, it is inferred that the majority of pre-service teachers are mathematical literate. Pre-service 
teachers were asked whether the STEM practice has made a change in their views on mathematical literacy. The 
answers given by the pre-service teachers are given in Table 11. 


Table 11. Answers to the question “Have your views on Mathematical literacy changed after STEM applica- 
tions?” 


Codes f % 


True 6 50 


STEM applications have changed my views on Mathematical Literacy 
False 6 50 
When Table 11 is examined, it is seen that STEM applications cause a change in the opinion of 50% of the 
pre-service teachers (n = 6), but in the remaining half, there is no change in their opinions. Pre-service teachers 
were asked what the letters in the STEM abbreviation mean. The answers of the pre-service teachers about words 


wu 


“Science”, “Technology”, “Engineering” and “Mathematics” are given in Tables 12, 13, 14 and 15. 
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Table 12. Answers related to the question “Could you define what the letter“S for Science” means in the word 


STEM?” 
Codes Student Codes f % 
Itis the basis of STEM education 01, 02, 03, 04, 06, 010, 011, 012 8 66.66 
Effort for understanding and studying the nature 01, 04, 05, 07, 09, 012 6 50 
Science is in every area of life 02, 08, 012 3 25 
More broad and meaningful than science and contains of it. 01 1 8.33 


When Table 12 is examined, it is seen that pre-service teachers state that Science is the basis of STEM educa- 
tion, that it is an effort for understanding and studying the nature, that Science in in every area of life and Science 
is not just physical science but consists of it and is broader and more meaningful. 


Table 13. Answers related to the question “Could you define what the letter “T for Technology” means in the 


word STEM?” 

Codes Student Codes f % 
Technology is the process of creating new ideas, products and innovation. 01, 03, 04, 05, 07, 08 6 50 
Technology S formed by the combination of disciplines of science, mathemat- 02, 03, 09, 011, 012 5 44.65 
ics and engineering. 
Technology is not just a computer or a phone, but also is a pencil. 03, 09, 011 3 25 
Technology stands for economy and prosperity. 08, 010, 012 3 25 
Technology is a tool used in high-quality lesson. 01 1 8.33 
Technology is a field that has emerged to meet people’s needs. 010 1 8.33 





When Table 13 is examined it is seen that, half of the pre-service teachers state that technology is the process 
of creating new ideas, products and innovation, 41.65% of them state that technology is formed by the combina- 
tion of disciplines of science, mathematics and engineering and that it is not just a computer or a phone, but also 
is a pencil. Furthermore, pre-service teachers state that technology stands for economy and prosperity, that it is a 
tool used in high quality lessons, and that Technology is a field that has emerged to meet people's needs. 


Table 14. Answers related to the question “Could you define what the letter”M for Mathematics” means in the 


word STEM?” 
Codes Student codes f % 

Mathematics is a must for STEM 03, 04, 05, 07, 08, 09, 010, 012 8 66.66 
Mathematics is mathematical modeling 01, 04, 05, 08, 010 5 41.65 
Mathematics is a discipline that links with other disciplines. 06, 08, 09, 012 4 33.33 
Mathematics is a discipline that is used everywhere in life 07, 08, 09 3 24.99 
Mathematics is a discipline that enables the development of many 010,012 9 16.66 
characteristics of the students 

Mathematics is the field that enables one to be successful in the PISA / 010, 011 9 16.66 
TIMSS exams. 

Mathematics is a systematical field. 02 1 8.33 


When Table 14 is examined, it is seen that pre-service teachers state that mathematics is a must for STEM 
education, that it represents mathematical modeling, and that mathematics is a discipline that links with other 
disciplines. Pre-service teachers also state that mathematics is a discipline that is used everywhere in life, that it 
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enhances students’ skills in many aspects, that mathematics is the field that enables one to be successful in the 
PISA / TIMSS exams and that it is a systematical field. 


Table 15. Answers related to the question “Could you define what the letter “E for Engineering” means in the 


word STEM?” 
Codes Student codes f % 

Engineering is a combination of Science and Mathematics disciplines. 01, 02, 03, 04, 05, 06, 09, 011, 012 9 74.97 
Engineering is a process of designing and creating a product. 01, 02, 03, 04, 05, 07, 09, 011, 012 9 74.97 
Engineering is the solution to real-world problems. 01, 04, 011, 012 4 33.33 
Engineering is the application part of the STEM education. 01, 06, 09 3 24.99 
Engineering is an approach that responds to human needs and require- 09 1 8.33 
ments. 


When Table 15 is examined, it is seen that the pre-service teachers state that engineering is a combination 
of disciplines of science and mathematics, that engineering is a process of designing and creating a product and 
a solution to real-world problems. In addition, pre-service teachers expressed that engineering is the application 
part of STEM education and that it is an approach that responds to human needs and requirements. 

The question “What are the features teachers should have as a result of STEM applications?” was asked the 
pre-service teachers and the answers given by the pre-service teachers are shown in Table 16. 


Table 16. The answers to the question “What are the features teachers should have as a result of STEM prac- 





tice?” 

Codes Student codes f % 
Should have STEM Content Knowledge 01, 02, 03, 04, 06, 08, 09, 011, 012 9 75 
Should have Pedagogical Knowledge 01, 04, 05, 06, 07, 08, 09, 012 8 66.66 
Should be able to establish interdisciplinary correlation 01, 04, 06, 010 4 33.33 
Should be enthusiastic 01, 08, 010 3 24.99 
Should have integration knowledge 05, 012 2 16.66 
Should associate with real life 03, 05 2 16.66 
Should be able to develop product 04, 05 2 16.66 
Must follow developments 06, O7 2 16.66 
Should be open to innovations 010, 012 2 16.66 
Should have general knowledge and ability. 09 1 8.33 
Should have 21st century life sciences knowledge 05 1 8.33 


When Table 16 is examined, it is emphasized that pre-service teachers should have STEM knowledge, peda- 
gogical knowledge and establish interdisciplinary correlation at the top qualifications that pre-service teachers 
should have in order to know how to apply STEM education. These are followed by being an enthusiastic person, 
having integration knowledge, associating with real life, developing products, following developments, being open 
to innovations, having 21st century life sciences knowledge and having general knowledge and ability. 

The difficulties faced during STEM applications in preparing the lesson plan were asked the pre-service teach- 
ers. The answers to the question about the difficulties experienced by pre-service teachers are shown in Table 17. 
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Table 17. Answers to the question “What were the difficulties faced while preparing the lesson plan during 
the STEM applications?” 


Codes Student codes f % 
Lack of STEM content knowledge 02, 03, 04, 07, 08, 09, 010, 011, 012 9 75 
Lack of establishing interdisciplinary correlations 01, 02, 03, 04, 08, 012 6 49.98 
Lack of associating with real life 02, 03, 04, 08, 012 5 41.65 
Lack of lesson developing knowledge 05, 06, 08, 09, 012 5 41.65 
Lack of pedagogical knowledge 09, 012 2 16.66 
Lack of application knowledge 010 1 8.33 
Lack of integration knowledge 08 1 8.33 
Lack of assessment and evaluation skill 04 1 8.33 


Examining Table 17, it is evident that the pre-service teachers have difficulty in expressing the difficulties they 
encountered while preparing the lesson plan, and that they are lacking in STEM content knowledge, interdisciplin- 
ary correlationship and association with real life. These are followed by the lack of knowledge on lesson planning 
preparation, pedagogy knowledge, integration knowledge, and assessment and evaluation skills. 

They were asked whether they felt sufficient about STEM education. The answers given by the teacher for 
this question are given in Table 18. 


Table 18. Answers to the question “Do you feel sufficient about STEM education?” 


Codes Student codes f % 
Sufficient 01, 06, O07 3 24.99 
About STEM education, | believe | am... Partially Sufficient 02, 08 2 16.66 
Insufficient 03, 04, 05, 09, 010, 011, 012 7 58.35 


When Table 18 is examined, it is found that 24.99% of the pre-service teachers are sufficient and 16.66% are 
partially sufficient with STEM education. However, 58.35% of pre-service teachers feel insufficient about STEM 
education. 


Discussion 


In this research, the effects of STEM applications on math literacy self-efficacy, technological pedagogical 
content knowledge and mathematical thinking skills have been examined. As a result of the study, it has been 
determined that the STEM applications changed the mathematics literacy self-efficacy of the prospective teachers 
positively. According to this result, it can be said that STEM applications have a positive effect on mathematical 
literacy. It can be said that researches related to mathematics education conducted during the implementation of 
STEM applications have positive effects on mathematical literacy. When examining the literature on STEM educa- 
tion, it has been emphasized that STEM education improves mathematics and science literacy in many studies 
(Medeiros, 2011;Weber, Fox, Levings & Bouwma-Gearhart, 2013). In Figliano (2007), STEM education has contributed 
to the development of science and mathematics literacy, and even to the development of STEM literacy. It is also 
understood that STEM education also improves the technological literacy (Wang, Moore, Roehring & Park, 2011). 
Moreover, this study is also important in terms of the fact that the STEM applications are the first applied studies 
on mathematical literacy. 

In the scope of the research, the effects of STEM applications on mathematical thinking of pre-service teach- 
ers have been also examined. As a result of the study, it was concluded that STEM applications did not positively 
affect the Mathematical Thinking of students of mathematics teaching department. STEM applications seem to 
have a positive impact on the high-level thinking tendency and reasoning dimension. However, it shows that STEM 
applications have no positive effect on mathematical thinking and problem solving. Studies on STEM education 
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have improved students’ high-level thinking skills positively (Morrison, 2006; Yildirim & Selvi, 2017). Yildirim (2016) 
studied the effects of STEM applications on high-order thinking skills of students. As a result of the research, it was 
concluded that STEM applications positively affected students’ high-level thinking skills. It is seen that the results 
obtained by the researcher are similar to those obtained in this study. Kim and Choi (2012) researched the effect 
of the science-based STEAM program on problem solving skills. As a result of the research, it is found that the 
science-based STEAM program had a positive effect on students’ problem-solving skills. Krishnamurthi, Ballard 
and Noam (2014) studied the effects of post-school STEM programs. As a result of the researches, they found that 
STEM programs contributed positively to the development of problem solving skills. Wang (2012) stated that the 
purpose of the STEM integration courses was to improve problem-solving skills. However, when the literature is 
examined, it is seen that STEM applications also have positive effects on the attitude, interest, academic success, 
scientific process skills and motivation of the individuals (Chittum, Jones, Akalin & Schram, 2017; Olivarez, 2012; 
Park & Yoo, 2013; Yamak, Bulut & Duindar, 2014). These results show that STEM applications have a positive effect 
also on different variables. 

In the scope of the research, the effect of STEM applications on pre-service teachers ‘ technological peda- 
gogical content knowledge has been examined. As a result of the study, it is concluded that STEM applications 
had positive influence on Technological Pedagogical Content Knowledge of pre-service teachers. The effects of 
STEM applications on Technological Pedagogical Content Knowledge sub-dimensions are also examined. As a 
result of the findings, it was determined that the STEM applications had positive effects on the sub-dimensions of 
Mathematics, Social Science and Science-Literacy Knowledge and Pedagogical Knowledge sub-dimensions. These 
results show that STEM applications have a positive effect on the field of knowledge. In addition, this end result 
supports the results obtained during the interviews with pre-service teachers. Similar results were obtained in the 
studies in which the effects of STEM applications on teacher opinions were examined (Lee, Park & Kim, 2013; Lee 
et al., 2012; Thomas, 2014; Wang, 2012). 

Pre-service teachers were asked about their views on mathematical literacy, and in the light of their views it 
is seen that, all of the pre-service teachers were able to define mathematical literacy. In addition, while the vast 
majority of pre-service teachers express that they are mathematics literate individuals, some pre-service teachers 
have stated that they are not mathematics literate. However, STEM education applications have shown that half 
of the pre-service teachers have positively changed their views on mathematical literacy. This result also supports 
the results of the first sub-problem. The results obtained from the opinions of the pre-service teachers seem to 
support the results obtained from the quantitative data. In this context, the results show that STEM applications 
have positive effect on pre-service teachers to have positive views on mathematics literacy. Weber, Fox, Levings 
and Bouwma-Gearhart (2013) also pointed out that a teacher must be a science and mathematics literate in order 
to solve a problem in everyday life. They also stated that it developed science and mathematics literacy. 

Pre-service teachers expressed the need for teachers to have STEM knowledge, pedagogy knowledge, in- 
terdisciplinary correlations, integration knowledge, association with real life and to be enthusiastic in order for a 
teacher to apply STEM education. They also pointed out that teachers need to be productive, follow developments, 
be open to innovations, have 21st century life sciences knowledge, and have general knowledge and ability. When 
the literature is examined, it is emphasized that teachers should have a lot of knowledge about STEM education 
such as STEM knowledge, pedagogy knowledge, integration knowledge, 21st century life sciences (Abell, 2007; 
Ball, Thame & Phelps, 2008; Kula, Ozgiir & Elci, 2013; Shulman, 1986; Yusof, Zakaria & Maat, 2012; Wang, Moore, 
Roehring & Park, 2011). It can be said that the teachers who do not have adequate equipment in the STEM content 
knowledge will have problems in their teaching. Besides this, besides having sufficient knowledge about STEM, a 
teacher should also have good pedagogy knowledge (Briscoe & Peters, 1997; Shulman, 1986). A teacher with good 
pedagogical knowledge will play an important role in teaching the subject effectively. Kennedy, Ahn and Choi 
(2008) emphasized that teachers should have knowledge of STEM-related content and pedagogy. Ostler (2012) 
states that teachers should have pedagogical knowledge to know and learn the knowledge of STEM disciplines so 
that they can apply STEM education in their lessons. Weber, Fox, Levings and Bouwma-Gearhart (2013) in their work 
with teachers emphasized the importance of integrating with STEM disciplines in order to practice STEM-related 
applications. These considerations show parallelism with the results obtained in this study. 

It has been determined that candidate teachers do not have enough information about STEM content knowl- 
edge, interdisciplinary relationship, connection with daily life, pedagogy information, integration knowledge, 
practice and measurement and evaluation while preparing appropriate course plan for STEM education. However, 
it was also found that the majority of the pre-service teachers were insufficient in STEM education, and that a small 
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part of them felt themselves sufficient and partially sufficient with STEM education. In their work with teachers, 
Weber, Fox, Levings and Bouwma-Gearhart (2013) have mentioned about the difficulties faced by teachers. The 
first of these difficulties is that teachers cannot establish interdisciplinary correlations and cannot master the entire 
STEM disciplines. In this study, teachers expressed that the second difficulty is the lack of resources even if they are 
sufficient about STEM education. In their work with teachers, Wang, Moore, Roehring and Park (2011) stated that 
teachers are lacking digital technological resources and a good STEM program for their use. Similarly, Wang (2012) 
emphasizes that a good program for STEM education is a must but sadly it is lacking. It can be said that the results 
obtained from these studies are similar to the difficulties that pre-service teachers have expressed themselves. 


Conclusions 


Within the scope of the research, it has been determined that STEM applications have positively changed 
the mathematical literacy self-efficacy and mathematical thinking skills of the pre-service teachers who study in 
mathematics teaching. It has also been understood that STEM applications have a positive effect on the high-level 
thinking and reasoning skills of pre-service teachers. However, it is understood that the STEM applications have no 
positive effect on the mathematical thinking and problem-solving skills of the pre-service teachers. 

Another result obtained within the scope of the research is that the STEM applications have a positive effect 
on the Technological Pedagogical Content Knowledge of the pre-service teachers. Moreover, it is understood that 
STEM applications have positive effects on mathematics, social sciences, science and literacy field knowledge and 
pedagogical knowledge. Moreover, it is understood that STEM applications have a positive effect on technologi- 
cal pedagogical knowledge. However, it has also been understood that STEM applications do not have a positive 
impact on Technology Knowledge, Pedagogical Content Knowledge and Technological Field Knowledge. 

In the scope of the research it has been understood that STEM applications positively changed the opinions 
of pre-service teachers on mathematical literacy. In addition, in the direction of the opinions of pre-service teach- 
ers, in order for a teacher to apply STEM education it has been emphasized that STEM field knowledge, pedagogy 
knowledge, ability to associate interdisciplinary relationship, willingness, integration knowledge and connection 
with daily life must be found. This is also the result that pre-service teacher feels insufficient about STEM applications. 


Limitations of the Study and Recommendations 


This research was carried out with 29 pre-service teachers studying in elementary mathematics teacher edu- 
cation department for 3 hours a week for 6 weeks in 2016-2017 academic year spring semester. In this context, 
future researchers can work with pre-service teachers studying in different departments. In this study, dependent 
variables are “Mathematical Thinking Skills”, “Mathematical Literacy Self-efficacy” and “Technological Pedagogical 
Content Knowledge”; while the independent variable is STEM applications. Therefore, future researchers may 
examine the effects of STEM education on different dependent variables. Moreover, in this study, the opinions 
of pre-service teachers on STEM education were examined. Future researchers may examine different groups’ 
opinions on STEM education. 
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